Vector-Ordering Filter Procedure for Data Reduction 

The essential characteristics of original large sets of data are preserved. 

Marshall Space Flight Center, Alabama 


The vector-ordering filter (VOF) tech- 
nique involves a procedure for sampling 
a large population of data vectors to se- 
lect a subset of data vectors that fully 
characterize the state space of the large 
population. The VOF technique enables 
a large reduction of the volume of data 
that must be handled in the automated- 


monitoring system and method dis- 
cussed in the two immediately preceding 
articles. In so doing, the VOF technique 
enables the development of data-driven 
mathematical models of a monitored 
asset from sets of data that would other- 
wise exceed the memory capacities of 
conventional engineering computers. 


Data-driven mathematical models 
have been shown to offer high fidelity 
for purposes of control and monitoring 
of assets. In practice, a collection of 
asset-operating observations is acquired 
with the intention that the collection 
contain observations characteristic of 
the full dynamic range of operation of 
the asset. Often, such a collection con- 
tains an extremely large number of ob- 
servations, many of which are redun- 
dant. The VOF technique fills the need 
for a means to extract, from the original 
collection of observational data, a re- 
duced data matrix that excludes redun- 
dant data while maintaining the full sta- 
tistical character and dynamic range of 
the original data. The reduced data ma- 
trix can then be used as the input data 
for development of a mathematical 
model of the monitored asset, or as 
training data for a neural-network sub- 
stitute for an explicit mathematical 
model of the asset. Alternatively, the re- 
duced data matrix can, itself, be used di- 
rectly as a mathematical model of the 
monitored asset, as is commonly done in 
multivariate state-estimation techniques. 

The original data are collected from 
the asset over a range of operating states 
and are put in matrix form. Each col- 
umn vector in the original data matrix 
represents the signal values acquired at a 
particular operational state of the asset. 
Thus, the number of columns of the 
original data matrix equals the number 
of observed states and the number of 
rows in this matrix equals the number of 
signals acquired at each observation. In 
the VOF technique, one extracts the re- 
duced data matrix from the original 
data matrix through the selection of a 
representative subset of the column 
(state) vectors. 

In its simplest form, the VOF proce- 
dure is a two-stage procedure, in the first 
stage of which one selects those data vec- 
tors that characterize the extrema pre- 
sent in the original data. At the begin- 
ning of the first stage, one finds the 
extrema of each signal as represented by 
the minimum and maximum values in 
the corresponding row of the original 
data matrix. The column vectors that 
contain these values are selected as can- 
didates for inclusion in the reduced data 
matrix. Before a candidate column vec- 
tor is added to the reduced data matrix, 
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These Plots Characterize Data from an original data matrix and a reduced data matrix derived from 
it in two VOF passes. The original set of data represented 62,914,252 observations, each observation 
comprising readings of 6 accelerometers on the space shuttle main engine. The first VOF pass, made 
over 394 subsets of the original data, yielded a reduced data matrix of 160,358 vectors. The second 
pass extracted a final reduced data matrix containing 250 vectors. 
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it is compared with those column vectors 
already in the reduced data matrix to en- 
sure that only one copy of that vector 
ends up in the reduced data matrix. In 
the second stage, one orders the column 
vectors of the original data matrix by 
their Euclidean norms and then selects a 
subset of the vectors according to a spac- 
ing criterion. All column vectors se- 
lected in this way are compared to those 
vectors selected during the first stage. 
Only those column vectors that were not 
already included in the reduced data 


matrix during the first stage are added 
to the reduced data matrix. 

Practical sets of data tend to be so 
large that excessive computer memory 
would be necessary for a single pass of 
the two-stage VOF procedure over all 
the data. In such a case, the VOF pro- 
cedure can be applied recursively to 
successive subsets of the original data 
that are small enough to fit in the 
available memory. The figure presents 
plots from an example of a two-pass ap- 
plication of the VOF technique to 


some space-shuttle engine vibration 
data. 

This work was done by Randall L. Bick- 
ford of Expert Microsystems, Inc., and 
James R Herzog of Argonne National Labo- 
ratory for Marshall Space Flight Center. 

This technology is immediately available 
using the SureSense™ Signal Validation 
System software produced by Expert Mi- 
crosystems, Inc. For more information, con- 
tact the company at (916) 989-2018 or at 
expert@expmicrosys. com. 

MFS-31588 


Remote Sensing and Information Technology for Large Farms 

Timely data on spatial and temporal variations in fields help farmers manage crops. 

Stennis Space Center, Mississippi 


A method of applying remote sens- 
ing (RS) and information-management 
technology to help large farms produce 
at maximum efficiency is undergoing 
development. The novelty of the 
method does not lie in the concept of 
“precision agriculture,” which involves 
variation of seeding, of application of 
chemicals, and of irrigation according 
to the spatially and temporally local 
variations in the growth stages and 
health of crops and in the chemical 
and physical conditions of soils. The 
novelty also does not lie in the use of 
RS data registered with other data in a 
geographic information system (GIS) 
to guide the use of precise agricultural 
techniques. Instead, the novelty lies in 
a systematic approach to overcoming 
obstacles that, heretofore, have im- 
peded the timely distribution of reli- 
able, relevant, and sufficient GIS data 
to support day-to-day, acre-to-acre deci- 
sions concerning the application of 
precise agricultural techniques to in- 


crease production and decrease cost. 

The development and promotion of 
the method are inspired in part by a vi- 
sion of equipping farm machinery to 
accept GIS (including RS) data and 
using the data for automated or semi- 
automated implementation of precise 
agricultural techniques. Primary ex- 
amples of relevant GIS data include in- 
formation on plant stress, soil mois- 
ture, and effects of applied chemicals, 
all derived by automated computa- 
tional analysis of measurements taken 
by one or more airborne spectrora- 
diometers. 

Proper management and timeliness 
of the large amount of GIS information 
are of paramount concern in agricul- 
ture. Information on stresses and 
changes in crops is especially perishable 
and important to farmers. The need for 
timeliness and management of informa- 
tion is satisfied by use of computing 
hardware and software capable of (1) 
rapid geo-rectification and other pro- 


cessing of RS data, (2) packaging the 
output data in the form of GIS plots, 
and (3) making the data available to 
farmers and other subscribers by Inter- 
net password access. It is a goal of this 
development program to make RS data 
available no later than the data after an 
aerial survey. In addition, data from 
prior surveys are kept in the data base. 
Farmers can, for example, use current 
and prior data to analyze changes. 

This work was done by John E. Williams 
of Global Positioning Solutions, Inc., and 
Jimmie A. Ramsay of DataStar, Inc. for 
Stennis Space Center. 

In accordance with Public Law 96-517, 
the contractor has elected to retain title to this 
invention. Inquiries concerning rights for its 
commercial use should be addressed to: 
Global Positioning Solutions, Inc. 

PO. Box 89 
Inverness, MS 38753 
Refer to SSC-00150, volume and number 
of this NASA Tech Briefs issue, and the 
page number. 
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